S3: pass fileprefix into getBucket calls
authorJoey Hess <joeyh@joeyh.name>
Mon, 10 Oct 2022 21:37:26 +0000 (17:37 -0400)
committerJoey Hess <joeyh@joeyh.name>
Mon, 10 Oct 2022 21:37:26 +0000 (17:37 -0400)
commitb4305315b26460bc5f694e50cbab4f2d713ad90e
tree133c6045838750935d717206ea1aa0213aaf18c8
parent90f9671e00d8421247f272fa283d76c9bf791043
S3: pass fileprefix into getBucket calls

S3: Speed up importing from a large bucket when fileprefix= is set by only
asking for files under the prefix.

getBucket still returns the files with the prefix included, so the rest of
the fileprefix stripping still works unchanged.

Sponsored-by: Dartmouth College's DANDI project
CHANGELOG
Remote/S3.hs
doc/todo/allow_for_annonymous_AWS_S3_access/comment_8_b0d9dbe81f01e80809381a9e5f6a883d._comment [new file with mode: 0644]